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scheduling problems that were previously considered computationally intractable. This paper describes a class of search 
Piques ^ intelligent Perturbation Algorithms. Several scheduling systems which use these algorithms to optima the 
scheduling of space crew, payload and resource operations arc also discussed. 


Using Heuristics for Optimization 

The development of techniques to solve scheduling 
problems has historically centered around the investigation 
of idealized scheduling models which were often simpler 
than problems typically encountered in the real world. 
Except for the simplest models, scheduling problems can be 
described mathematically as “NP-Hard.” 3 ' 14 All known 
mathematical techniques for finding optimal solutions to 
NP-Hard problems are too slow to solve realistically large 
problems . 15 

In practical applications, heuristic techniques arc 
often used to solve problems which are otherwise intractable. 
Heuristics usually produce solutions of good quality but do 
not always find the most optimal solution. Whereas the 
computational difficulty of finding the exact optimum solu- 
tion increases exponentially as a function of the size of an 
NP-Hard scheduling problem, with heuristic algorithms the 
difficultly of finding “quasi -optimal” solutions usually in- 
creases only in a polynomial fashion. Polynomial heuristic 
algorithms can therefore find solutions to realistic problems 
in a computationally feasible search time. 

In some cases, heuristic techniques can be shown to 
produce solutions which have desirable properties such as 
guaranteeing to always be within a certain percent of the 
optimal solution. For more complicated problems, however, 
even these guarantees may not be possible. In the case of 
many space related scheduling problems, the optimization 
criteria can be inexact and the data base (e.g. , estimates of the 
expected time necessary to complete an activity) may be 
uncertain; hence, a heuristic can be considered successful if 
it can be applied to a set of test problems and shown to 
consistently produce schedules which are nearly optimal. 
With confidence in such a heuristic it could then be applied 
to larger and more complicated problems for which finding 
the optimum is not realistic. Additionally, having a heuristic 
which can compute a solution on a time scale fast enough for 
the solution to be used immediately (as would be necessary 
to perform real-time replanning) is superior to producing a 
nominally better solution which cannot be obtained in real 
time. 


Intelligent Perturbation Algorithms 

A typical scheduling problem involves the placing 
of activities onto a timeline while respecting constraints 
which may restrict the times at which the activities many be 
performed and the resources available for the activities to 
use. A grading function is established to judge the relative 
merits of different schedules. 

Intelligent Perturbation Algorithms are heuristic 
techniques that have been developed by the author for the 
quasi-optimization of complex scheduling problems. These 
algorithms iteratively search the combinatoric solution space 
just as techniques such as gradient search are used for sol v ing 
continuous domain optimization problems. Like other itera- 
tive search techniques such as Simulated Annealing Algo- 
rithms 1 * 5716 and Genetic Algorithms 1718 , Intelligent Pertur- 
bation Algorithms iteratively examine (and make perturba- 
tions upon) successive schedules in an attempt to find a 
progressively better solution. Unlike these other techniques 
(which search in a more random fashion), Intelligent Pertur- 
bation Algorithms use a strategy that considers both the 
structure of the problem’s constraints and its objective func- 
tion to decide how to modify a schedule to increase the like- 
lihood that the next perturbation will yield a more optimal 
solution. 

To create an initial schedule (the first iteration), a 
method is devised to generate a ranking of all unscheduled 
activities, and then the highest ranked activity is added to the 
timeline. The procedure is then repeated to select the activity 
with the next highest ranking, adding it to the timeline. This 
continues until all the activities (or as many as possible) have 
been added to the schedule. The particular method used to 
initially rank the activities and the specific way in which 
activities are added to the timeline are not pertinent to the 
general operation of the Intelligent Perturbation Algorithm. 

Following this first iteration, the rankings of the 
activities are adjusted using a problem specific procedure 
called a perturbation operator. These new rankings are then 
used on the next iteration to produce another schedule which 
is hopefully of superior quality (as measured by the grading 
function). This process then repeats for subsequent iterations 
until a cutoff criteria is reached. The best schedule found 
during the course of the search is then recalled. 
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Emperical experience has shown that good pertur- 
bation operators share many characteristics: 

1) The operator should increase the rankings of an 
activity or activities which were not satisfactorily 
scheduled during the previous iteration. The opera- 
tor should also increase the rankings of “bottle- 
neck” activities (which may have been successfully 
scheduled) that prohibited the satisfactory schedul- 
ing of other activities due to temporal constraints 
linking those activities to the bottleneck activity. 

2) The operator should be able to potentially span the 
search space in a small number of steps. 

3) The computational overhead of computing the 
perturbations between each iteration should be 
small compared to the computational cost of pro- 
ducing a single schedule. Extensive testing has 
shown that by looking at many good schedules, 
Intelligent Perturbation Algorithms arc likely to 
find a very good schedule in a reasonable number of 
iterations. There is a greater payoff in searching 
through more schedules than in investing a great 
deal of computation in the perturbation operator. 
This is consistent which the strategy employed by 
the best chess playing computer programs which 
achieve their skill by searching through a large 
number of positions rather than through the use of 
strategy. 

4) The perturbation operator should have a random 
component (or some other provisions) for avoiding 
loops and getting trapped near local optima. 

For many space operations, the costs of opportuni- 
ties which are lost due to inefficient scheduling can easily 
amount to millions of dollars per week. The proper design of 
the perturbation operator is critical to the success of the Intel- 
ligent Perturbation Algorithm, and will vary for different 
types of scheduling problems. The specific details can be 
considered proprietary; as the utilization of space becomes 
more commercial, the possession of good perturbation op- 
erators can provide a capability to operate more efficiently 
and thereby bestow a competitive advantage. 

Intelligent Perturbation Algorithms can be made 
flexible enough to accommodate a large range of problem 
structures including highly 
complicated constraint envi- 
ronments which could not be 
addressed by previous heu- 
ristic optimization methods. 

The search inherently fo- 
cuses on the complicated 
parts of a scheduling prob- 
lem while it avoids dealing 
with factors which are not 
present in a particular prob- 
lem instance. 

Figure 1 shows re- 
sults of using the Intelligent 
Perturbation Algorithm, av- 
eraged over many lest prob- 
lems. 10 In each problem, the 
objective was to generate a 


timeline which allowed completion of a set of time and 
resource-constrained activities as early as possible. Using 
non-iterative heuristic techniques standard in operations 
research literature, solutions were found which averaged 
about 23% longer than optimal ; after 1 0 search steps using an 
Intelligent Perturbation Algorithm, average schedule quality 
was improved to within 10% of the optimum, a significant 
improvement. After 100 search steps, Lhe average schedule 
quality was improved to only 7% longer than the optimum. 
Usage on many different problems has shown that while the 
scaling of the axes will vary for different types of scheduling 
problems, the general character of the “learning curve” 
relating schedule quality to the number of iterations remains 
largely unchanged. 



Figure 1: Solution Improvement with Iteration Number 

Intelligent Perturbation Algorithm Applications 

Aerospace systems have been developed which 
apply Intelligent Perturbation techniques to the scheduling of 
crcw, payloads, and resources aboard space-based systems. 
Space Industries is examining the application of Intelligent 
Perturbation Algorithms beyond the aerospace industry into 
diverse areas such as the optimization of petrochemical plant 
operations and the scheduling of medical operating rooms. 
Additionally, an independently developed iterative refine- 
ment methodology, called chronology-directed search, has 
been developed at J PL and is being applied to the scheduling 
of deep space missions. 2 

Space Station Scheduling 

Aboard the International Space Station Freedom , 
crewmembers would benefit from having the capability to 
participate in the scheduling of their own activities. To 
address this need a prototype 
interactive software tool 
known as the MFIVE Space 
Station Crew Activity Sched- 
uler and Stowage Logistics 
Clerk was developed at the 
Space Systems Laboratory of 
the Massachusetts Institute of 
Technology (MIT). 10 - »■ 12 
MFIVE (Figure 2) provides a 
user friendly interface for 
building, solving and display- 
ing scheduling problems as 
well as for investigating the 
features which will be neces- 
sary to provide a real-time 
scheduler for use aboard 
Freedom. 



Figure 2: MFIVE Space Station Scheduling Worksheet Showing 
Task Assignment and Resource Usage lor Five Crewmembers 
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MFIVE was not intended to provide a fully robust 
model of the real istic Space Station environment butrathcr to 
demonstrate some of the features which will be necessary to 
support development of actual Space Station planning and 
scheduling tools. While the MFIVE system was created to 
deal primarily with manned activities, it is also capable of 
dealing with unmanned operations. First prototyped in 1 986, 
MFIVE was used to develop and test the initial implementa- 
tions of the Intelligent Perturbation Algorithm. MFIVE also 

demonstrated user-friendly features such as graphics, win- 
dows, menus and a mouse-driven interface on a low cost 
Macintosh desktop computer. 

MFIVE is currently being used by the MIT Man- 
Vehicle Laboratory to examine scheduling scenarios for the 
Spacelab SLS-1 and IML-1 life sciences prc/postflighi 
baseline data collection facility. These data collection ses- 
sions provide control data to compare against data collected 
on-orbit and measure post-mission readjustment to earth s 
gravity. 

Another optimization tool using the Intelligent Per- 
turbation Algorithm has been developed to support work 
being done for the Space Station Program Support Contract 
for the scheduling of Space Station Design Reference Mis- 
sions (DRMs). Scheduling of DRMs involves generating 
demonstration timelines for Space Station crew and payload 
operations at selected periods during the li fetime of the Space 
Station. As shown in Figure 3, schedules have been gener- 
ated which show significant improvements over schedules 
produced with standard scheduling tools, both in terms of 
resource utilization and in the accomplishment of mission 
priorities • The analysis of this DRM required the schedul- 
ing of 422 requested operations of 74 payloads over a two 
week period. Three resources were considered: crew, 

power, and the availability of a high quality microgravity 
environment. Assuming a rate of $100,000 per IVA crew- 
hour (as called out by NASA in its recent request for propos- 
als for the Commercial Middeck Augmentation Module), 
the optimization analysis saved 5.3 million dollars per week 
in opportunity costs that would have otherwise been lost 
through inefficient scheduling. 


DRM 4 - Command l Control 

Zone Operations/Man-Tended 
Free Flyer Servicing 

Payload 

Runs 

Crew-Hours 

Scheduled 

Requested 

Available 

NASA Provided Baseline 
Space Industries Result 

422 

N/A 

272 

3B7 

S39 hr, 10 min (11814) 
4Sfc hr, 30 min (100.04) 
333 hr, 35 min { 73.14) 
44 0 hr , 10 min ( 96.44) 


Figure 3: DRM 4 Resource Utilization Optimization 


Industrial Space Facility Scheduling 
The ability to provide flexible manifesting and 
scheduling is critical to the operation of the Industrial Space 
Facility (ISF), a man-tended free-flying space platform being 
developed by Space Industries for launch in the 1990s. The 
ISF has been designed to serve as a bridge to the Space 
Station era, providing a high-power, low-gravity environ- 
ment for conducting microgravity research. A software tool 
called the Prototype ISF Experiment Scheduler has demon- 
strated that efficient and cost-effective operation of the ISF 
is possible through the use of multi-variable optimization 
techniques based on the Intelligent Perturbation Algorithm. 9 


Figurc4 (next page) shows resource utilization profiles for an 
optimized l(X)day ISF mission. Ihc objective function was 
based largely on maximization of power utilization. 
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Figure 4: Optimized ISF Schedule 


1 1 3] Lawler, E.L., Lenstra, J.K., “Machine Scheduling 
with Precedence Constraints." Slichting Mathematisch 
Centrum, Amsterdam, Department of Operations Research, 
September 1981. 

[14] Papadimitriou, C.H., Steiglitz, K., Combinatorial 
Optimization: Algorithms and Complexity. Prentiss- Hall, 
Inc., Englewood Cliffs, New Jersey, 1982. 

[15] Patterson, J.H., “A Comparison of Exact Ap- 
proaches for Solving the Multiple Constrained Resource, 


Project Scheduling Problem.” Management Science, Vol. 
30, No. 7, July 1984, pp. 854-867. 

[16] Price, C.C., and SaJama, M.A., “Scheduling of 
Precedence -Constrained Tasks on Multiprocessors.” JPL 
Invention Report NPO- 172 19/6725, January 1989. 

[17] Sponsler, J.L., “Genetic Algorithms Applied to the 
Scheduling of the Hubble Space Telescope.” N89-26607. 

[18] Waltbridge,C.T.,“GeneLic Algorithms.” Technol- 
ogy Review, Vol. 92, No. 1, January 1989. 


298 




Appendix D-Bibliography 


PRECED'i'G PAGE DLAMX NOT FILMED 



Appendix D — Bibliography 


Conference Introduction 

CTA Incorporated, Planning & Scheduli ng Lessons Learned Study 
Executive Summary , June 29, 1990 


Session 1. Concepts for Space Network Resource Allocation 

Hornstein, R., J. Gardner, and J. Willoughby, Distributed PeClS10n~Muking 
for Snace Operations: A Programmatic Perspective and A Technical 
Perspective on Tools and Techniques . AIAA/NASA Second Internationa 
Symposium on Space Information Systems, Sept. 17, 1990 

Information Sciences, Inc., Adaptations to t he Tra dRicmfll Practice of 
Systems Engineering Management P r ocess: A Guidebook for Proie et 
Management . July, 1989 

Goddard Space Flight Center, Customer D ata Operations System (CDQS 1 
Operations Management Service (COMS) Planning and Scheduling 
Concent Assessment , by Computer Sciences Corp., May 1990, DSTL-90-010 

Wong, Y. and J. Rash, An RF Interference Mitigation Me thodolo gy with 
Potential Applications in Scheduling . Dec. 1990 (paper included in 
Appendix D) 

Wike, J., Automatic Conflict Resolution Issues . Dec. 1990 (paper included 
in Appendix D) 

Geoffroy, A., D. Britt and J. Gohring, The Role of AI Techniqu es in 
Scheduling Systems . 1990 Goddard Conference on Space Applications of 
Artificial Intelligence, May, 1990, NASA CP 3068 

Durham, R., N. B. Reilly and J. B Springer, Resource Allocation Pl anning 
Helner - RAT. PH: Lessons Learned . 1990 Goddard Conference on Space 
Applications of Artificial Intelligence, May, 1990, NASA CP 3068 


Session 2. SNC and User POCC Human-Computer Interface Concepts 

Biefeld, E. and L. Cooper, Operations Mission Planner Fin al Report, March 
15, 1990, JPL Publication 90-16 

Goddard Space Flight Center, Design of P lanning and Scheduling 
Interfaces: Guidelines and Display Concepts , by CTA, Inc., Dec. 1990, 
DSTL-90-027 


301 


PRECEDING PAGE BLANK NOT FILMED 




Zoch, D., D. LaVallee, S. Weinstein and G. M. Tong, A Planning Language 
for Activity Scheduling . Dec. 1990, (paper included in Appendix D) 

Goddard Space Flight Center. User's Guide for the Flexible Envelop e 
Request Notation (FERN) , by Computer Sciences Corp. and Loral AeroSys, 
Sept. 1989, DSTL-89-015 

Weiland, W., E. Murphy, et al, Computer-Human Interaction Models 
(CHIMES)-2 System (Revised Report) . GSFC Contract NAS-5-30680, Feb. 28, 
1991 

Thalman, N. and T. Sparn, SURE (Science User Resource Expert): A 
Science Planning and Scheduling Assistant for a Resource Based 
Environment . 1990 Goddard Conference on Space Applications of Artificial 
Intelligence, May, 1990, NASA CP 3068 

Goddard Space Flight Center, Network Control Center (NCC) User 
Planning System (UPS) Detailed Design Specification , by Computer 
Sciences Corp., 1990 


Session 3. Resource Allocation Tools, Technology, and Algorithms 

Johnston, M., SPIKE: AI Scheduling for NASA's Hubble Space Telescope . 
Proceedings of the Sixth Conference on Artificial Intelligence, March 5-9, 
1990, IEEE Computer Society Press, pp. 184-190 

Kurtzman, C., Intelligent Perturbation Algorithm for Space Scheduling 
Optimization . Dec. 1990 (paper included in Appendix D) 

Goddard Space Flight Center, A Study of Optimization Techniques for 
Activity Scheduling , by Computer Sciences Corp., Oct. 1989, DSTL-89-D11 

Logan, J. and M. Pulvermacher, Range Scheduling Aid User's Guide . 
Jan. 1990, WP-6965, MITRE Corp. Bedford, MA 

Goddard Space Flight Center, Request-Oriented Scheduling Engine (ROSE) 
Concepts and Capabilities , by G. Tong, July 1990, DSTL-89-020 

Britt, D., A. Geoffroy and J. Gohring, Managing Temporal Relations . 1990 
Goddard Conference on Space Applications of Artificial Intelligence, May, 
1990, NASA CP 3068 

McDonnell Douglas Space Systems Co., COMPASS 1 4 . 1989, COMPASS 
Information Planning and Scheduling Group, Houston, TX 


302 


NASA 

National Aeronautics and 
Space Administration 

1. Report No 


Report Documentation Page 


2 Government Accession No 


3. Recipient's Catalog No. 


NASA CP-3124 

4 Title and Subtitle 

Space Network Control Conference on Resource 
Allocation Concepts and Approaches 


5. Report Date 
September 1991 

6. Performing Organization Code 


7. Author(s) 

Karen L. Moc, Editor 


522 

8 Performing Organization Report No. 

9 1 B(X) 1 30 

10. Work Unit No 


9 Performing Organization Name and Address 

Goddard Space Flight Center 
Grcenbelt, Maryland 20771 


1 1 . Contract or Grant No 


j 12. Sponsoring Agency Name and Address 

National Aeronautics and Space Administration 
Washington, D C. 20546-0001 

15 Supplementary Notes 

Karen L. Moc: NAS A-CISFC, (irecnbell, Maryland, 20771. 


13. Type of Report and Period Covered 

Conference Publication 

14. Sponsoring Agency Code 


16 Abstract 

This report describes the results of the Space Network Control (SNC) Conference on Resource Allocation Concepts 
and Approaches, which was held at die Goddard Space Flight Center on December 12-13,1 990. In the late 1 990s, 
when the Advanced Tracking and Data Relay Satellite System is operational. Space Network commumcatyion services 
will be supported and controlled by the SNC. The goals of the conference were to survey existing resource allocation 
concepts and approaches, to identify solutions applicable to the Space Network, and to identify fruitful avenues of 
investigation in support of the SNC development. About 75 people took part in the conference, both as speakers and as 
i participants in working-group discussions, to elicit recommendations for the future SNC. The conference was divided 
! into three sessions; 1) Concepts for Space Network Resource Allocation, 2) SNC and User Payload Operations Control 
Center (POCC) Human-Computer Interface Concepts, and 3) Resource Allocation Tools, Technology, and Algorithms. 
Key recommendations addressed approaches to achieving higher levels of automation in the scheduling process. Proto- 
typing was mentioned as an effective mechanism for verifying operations concepts and evaluating specific technology 

risks. 


1 7 Key Words (Suggested by Author(s) 

Planning, Scheduling, Resource Allocation, 
Scheduling Technology, Flexible Scheduling 
Requests, Space Network, Automation 


18 Distribution Statement 
Unclassified - Unlimited 

Subject Category 17 


19 Security Classif (of this report) 

i 

20 Security Classif (of this page) 

21 No. of pages 
316 

Unclassified 

Unclassified 



22. Price 
A14 


NASA FORM 1626 OCT 86 



